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Abstract 

In this paper, we discuss three extrapolation methods for a-stable random fields with a e (1,2]. We justify them, 
^^ giving proofs of the existence and uniqueness of the solutions for each method and providing sufficient conditions for 

^^ path continuity. Two methods are based on minimizing the variability of the difference between the predictor and the 

fSJ theoretical value, whereas in the third approach we provide a new method that maximizes the covariation between 

these two quantities. 
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P^ 1. Introduction 

PLh 

In many applications, Gaussian random fields are chosen as a model for the regionalized variables. However, 

natural phenomena may exhibit heavy tails such that the assumption of Gaussianity is not reasonable any more. In 

this case, stable random fields may be a more appropriate choice as they still possess the desirable properties of 

Gaussian random fields, but allow for heavy tails. 

In this paper, we are dealing with the problem of extrapolating an a-stable random field. Namely, based on a given 

^f-\ set of data points {x(f,))"^j at the locations f j , . . . , f„, n € N, which are part of a realization of an a-stable random field, 

J> we estimate the unknown value x(fo) at the location to i {ti, . . . ,t„}. We present three linear predictors of the form 

\0 x(fo) = ^ ^,x(f,), foeM"'. (1) 



The weights Ai,. . . ,A„ e M in (lib will be chosen in such a way that the predictor x(to) has certain desirable properties. 
Two predictors are based on ideas of previous work in the literature, namely we generalize the existing methods to a 
wide range of a-stable random fields and investigate the properties of existence, uniqueness, exactness, unbiasedness 
and continuity of the predictors in detail. We also propose a third new extrapolation method which maximizes the 
covariation dependence measure between the estimated and theoretical value. 

A 2-stable random field is a Gaussian random field. A widely used extrapolation technique for Gaussian random 
id fields is kriging which was invented by Krige in 1951, see ifTTI . The idea behind kriging is to find a linear predictor 

which minimizes the L^-distance between the predictor and the theoretical value. We refer to 1191 for further details 
about kriging. Since the second moment of an c-stable random variable does not exist when a < 2, the kriging 
technique cannot be applied to a-stable random fields so that one has to look for alternative extrapolation methods. 

There is a series of papers in the literature dealing with the extrapolation problem of particular stable random 
processes and fields. In llT6l . maximum likelihood estimation and conditional simulation of the fractional stable 
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motion is used to determine the optimal value at an unobserved location. Linear prediction of discrete a-stable 
processes based on minimizing the dispersion between the predictor and the theoretical value is discussed in HHJIEI 
HIS] 151 . Finally, a modified dispersion measure is minimized in [.13J in order to obtain a linear prediction of discrete 
a-stable processes with integral representation. 

The paper is organized as follows. In Sectionl2] we provide some basics about a-stable random fields. In Section 
l3] we present the three extrapolation methods for a e (1,2] (least scale linear predictor, covariation orthogonal linear 
predictor and maximum of covariation predictor) and analyze their properties. The proofs of the results can be found 
in the Appendix. 

2. Preliminaries 

In this section, we provide some basic definitions and results for a-stable random variables, random vectors and 
random fields. For a detailed introduction to a-stable distributions and processes, we refer to IfTSl . 

Definition 1 (a-stable random variable). Let < a < 2, cr > 0, -1 < p < 1, and ju e M. A random variable X is 
said to have an a-stable distribution with parameters cr, /3, and //, if its characteristic function (fx is given by 



MO) = 



[exp [-^"{91" (l - ipisign(0)) tan f ) -i- i/jO] , a ^ 1, 
[exp [-cr\6\ (l + i/3l(sign(0)) In \0\) + i^o) , a = L 



We briefly write X ~ Sa(o',/3,fJ.). The parameters cr, /3 and /i determine the scale, the skewness and the shift of the 
random variable, respectively, whereas the parameter a specifies the tail behavior of the distribution of X. We notice 
that 52(0", 0,//) = N(fi, 2cr^), where N{fi, Icr^) denotes the normal distribution with mean // and variance 2cr^. 
lfX~ SJcr,/3,ij.) with a e (0,2), then 

E\X\P < 00 for any p e (0, a), (2) 

E\X\P = 00 for any p e [a, 00). (3) 

Moreover if a e (0, 2) and /? = in the case a = 1, then for every p € (0, a) there exists a constant Ca^ip) > such 
that 

(Eixn"" = c„/p)cr. (4) 

An a-stable random vector is defined as follows. Let d eN and (■, ■) denote the Euclidean scalar product in M''. 

Definition 2 (a-stable random vector). Let < a < 2. We say that a random vector X - (Xi,. . . ,Xd)^ in R^ has a 
(multivariate) a-stable distribution if there exists a finite measure F on the unit sphere S''"' of M"' and a vector fi in 
M.'^ such that the characteristic function ipx is given by 



<Px(0) 



[exp {- /g,_, \{e, s}r (1 - /sign«0, *» tan f)r(ds) + 1(6, fi)] , a ^ 1, 
(exp{-/g,_, \{e,s}\{l+ilsignms}nnms}\)r(ds) + i{0,fx}}, a = 1. 



The pair (F,//) is unique. The spectral measure F on the unit sphere §''"' contains most information about X such 
as the dependence structure and distributional properties of its components. The vector // determines the shift with 
respect to the origin. We say that F is concentrated on a great sub-sphere of S''"' if it is concentrated on the intersection 
of S''"' with a(d - l)-dimensional linear subspace. If F is not concentrated on a great sub-sphere of §''"', then X is 
called full-dimensional. Otherwise, X is called singular. 

Lemma 1 (Linear dependence). Let c/ e N and consider a d-dimensional a-stable random vector X — (Xi , . . . , X^)^ . 
Let // = (0, . . . , 0) e W . X is singular if and only ifYji=i (^P^i — almost surely for some (ci , . . . , c,/) € M \ (0). 

Definition 3 (Linear regression). Let « e N and {Xi ,... , X„,X„+\)^ be an a-stable random vector. The regression of 

Xn+\ on (X\ , . . . , Xnf is called linear if there exist some constants ci , . . . , c„ e M such that 

n 

E(X„+i|Xi,...,X„) = 2]c* «-^- (5) 

i=\ 



Let sp(Z) denote the linear span of the a-stable random vector X. 

Definition 4 (Multiple regression property). Let n e N. The vector X has the multiple regression property if for all 
random variables Fi, . . . , F„+i e sp(Z) 

E(y„+i|yi,...,y„)esp((Fi,...,F,y). 

A random vector X in W' is called symmetric if P(Z e A) = P(-Z e A) for any Borel set A e W' . If Z is a 
symmetric a-stable random vector in W^, its characteristic function ifx is given by 



ipxiO) = exp |- r ^ K0, s>rT(fl'*)| , e e : 



For symmetric a-stable distributions, we use the standard abbreviation S aS . 

The dependence of two a-stable random variables cannot be studied by using the covariance because of the absence 
of the second moments if a < 2. Thus, we have to use a different dependence measure. The most popular dependence 
measure between two a-stable random variables is the covariation. It is only defined for a-stable random variables 
with 1 < a < 2. Let a^''^ := |fl|''sign(fl) denote the signed power for a e M and p eM.. 

Definition 5 (Covariation). Let a e ( 1 , 2] and F be the spectral measure of the a-stable random vector Z = (Xi , Za)^. 
The covariation of Xi on X2 is the real number 



[Zi,Z2]„:= f sis^''-'mdsuds2). 



The covariation is linear in the first entry, but in general not in the second. It is clear that [Zi , Z2]o, = if Xi and X2 are 
independent. For a = 2, we have [Zi,Z2]2 = 1/2 ■ Cov(Zi,Z2), where Cov(Zi,Z2) denotes the covariance between 
Xi andZ2, see IfTSl Example 2.7.2]. 

Let (Q., T , P) be the underlying probability space and Lo(^) be the set of all real random variables defined on 
it. Furthermore, let (E,S,m) be an arbitrary measurable space, /3 : E — > [-1, 1] be a measurable function and 
£0 := {A e fi : m(A) < 00). 

Definition 6 (a-stable random measure). An independently scattered cr-additive set function M : £0 — > Lo(Q.) such 
that for each A e £0 

( ,, i(5(x)m(dx) ] 
M(A)-sJ(m(A)f''/-^ — ,0 

(^ m(A) 

is called a-stable random measure on {E, S) with control measure m and skewness /3. 

Independent scatteredness means that for any collection Ai, A2, . . . , A„, n e N, of disjoint sets belonging to £0, the 
random variables M(A\), . . . , M{A„) are independent, whereas cr-additivity means that if IJ/li Aj e £0 for a sequence 
of disjoint sets Ai, A2, . . . e £0, then M(|J°lj Aj) - j;^i M(Aj) almost surely. 

A collection X = {X(t), t e M.''} of a-stable random variables is called a-stable random field. We consider random 
fields of the form 

X{t) = I f,(x)M(dx), teW', deN, (6) 

where /,:£—> M are measurable functions such that J \f,(x)\''m(dx) < 00 and in the case a = 1 additionally 
J \fix)/3ix) In \f{x)\\m(dx) < 00. The stochastic integral in m\ is defined in the natural way by approximating the 
functions /, by simple functions. We notice that the random Held Z in (J6]) is a-stable because its finite-dimensional 
distributions are a-stable. In particular, the scale parameter o-x{t) of X{t) is given by 



"'"' ^ X 



\f,(xrm(dx). (7) 



If j6(x) = for all x e E, then the corresponding a-stable random measure has SaS values and is called 5 orS' measure. 
In this case, the finite-dimensional distributions of X are symmetric a-stable, so we have that X is an 5 aS random 
field. 

Random fields with integral representation dSl comprise a rich subclass of c-stable random fields, namely random 
fields which are separable in probability, see ITS', Chapter 13]. In particular, all stochastically continuous a-stable 
random fields are separable in probability. 

Let Xj - J^ fj{x)M(dx), j - 1, 2, . . ., and X = j^ f(x)M(dx). Then for a ^ 1, it can be shown that 

phmX, - X <=> lim (Tx-x - 0, (8) 

where plim denotes convergence in probability, cf. ifTSl Proposition 3.5.1]. 

In ||4i Theorem 1 and Remark 1], it is shown that for to,tu- ■ ■ , t„ e Mf' it holds 



EiXitoWih), . . .,X(t„)) = Yj ^'^(^') 



(=1 
if and only if for all t e W 



Js« 



(v - <c, m)) <f, uy"-^^r(dv, du) = 0, (9) 



where F is the spectral measure of the random vector {X{t()),X(t\), . . . ,X(t„))^. If X is a moving average process, 
another criterion based on kernel functions for the regression of X(tQ) on (X(ti ),..., X(t„))^ to be linear is given in IH 
Section 4.4.]. 

Lemma 2. Consider a d- dimensional a-stable random vector X — {X\ , . . . , X^y with integral representation 

^ = ( r fi(x)M(dx), . . . , r Mx)M(dx)\ . 

Then X is singular if and only ifYji=\ (^ifii^) — m-almost everywhere for some vector {c\, . . . , cj)^ e M"' \ {0). 
Lemma 2 follows from Lemma 1 and the fact that cr'^^ - J \Yji=i Cifi(x)\ m(dx). 

Definition 7 (Covariation function). Let 1 < a < 2 and X be an a-stable random field. The function k : R^xR'' — > M 
defined by 

k(s, t) = [X(s), X{t)]a, s, t e W', 

is called the covariation function of X. 

For any a-stable random field X of the form (J6]l with 1 < a < 2, its covariation function is given by 

k(s, t)^ f f,(x)f{xr-'^m{dx). (10) 

A random vector (X, F)^ is called associated if, for any functions /, g : M^ — > M which are non-decreasing in each 
argument, one has 

Cov(/(X,F),g(X,F))>0 (11) 

whenever the covariance exists. It is called negatively associated if for any functions /, § : M ^ M which are 
non-decreasing, one has 

Cov(/(X),g(F))<0 

whenever the covariance exists. Notice that the condition Cov(/(X, Y),g{X, Y)) < does not make sense because 
Co\{g{X, F), g{X, F)) > for any non-degenerate random vector {X, F)^. 



Lemma 3 (Association, kernel functions). Let < a < 2 and (X, F)^ be an a-stable random vector with integral 

representation {X,Y)^ — (jfi(x)M(dx),jf2(x)M(dx)] . Then (X,Yy is associated (negatively associated) if and 
only if fifi > f/1/2 < Oj m-almost everywhere. 

Corollary 4 (Decomposition of a stable random vector). Let < a < 2 and {X, Y)^ be an a-stable random vector 
Then there exist a-stable random variables X\,X2, Y\, Yi such that 

X^Xi+Xi and Y ^Yy+ Y2 a.s., 

{X\ , Fi)^ is associated, (X2, ^2)^ is negatively associated and the components of each of the random vectors (Xi , X2)^, 
(Xi,Y2f, (Yi,X2y, (Yi,Y2y are independent. 

Due to Corollary HI the dependence relation between two a-stable random variables can be reduced to the associ- 
ation and negative association relations between their parts. The following corollary provides a justification for using 
the covariation as a dependence measure. It is a direct consequence of LemmalSland formula ( 10 1. 



Corollary 5 (Association, covariation). Let I < a < 2 and (X, Y)^ be an a-stable random vector If (X, Y)^ is 
associated (negatively associated), then [X, Y]a > ([X, Y]^ < Oj. 

The covariation is connected to the mixed moments by the following lemma. 

Lemma 6. Let I < a < 2 and suppose that {X, F)^ is an a-stable random vector with spectral measure T such that 
X ~ Sa{o'x,Px, 0) and Y ~ Sa(crY,/^Y, 0). For \ < p < a, it holds 

E(^y^^-'i ^ [X,YUl-c-l3y) + c-(X,Y)^ 

¥\Y\P crj ' 

where (X, Y)^ :- £, Si\s2C^^T{ds) and 

tan{an/2) 



C := Ca,p(J3Y) = 



ySy tan(a;r/2) - tan I — srctemifiy tan(Q;7r/2)) ] 



1 -Hj6|,tan2(ff7r/2) 

If Y is symmetric, i. e. fiy — 0, then c - 0. 

A random vector X is called sub-Gaussian if Z = A^^^G, where A ~ S a/2((cos(jTa /A))^^" , 1,0) and G is a zero 
mean Gaussian vector independent of A. This multivariate distribution is a particular case of the Gaussian scale 
mixture and the elliptical distributions. Consider a stationary zero mean Gaussian random field G - {G{t), t e M.''} 
with a positive definite covariance function C. Assume that the random variable A is independent of G. The random 
field 

X^{A^'^G(t),teR'^} 

is called sub-Gaussian random field. In IfTSl Example 2.7.4], it is shown that for sub-Gaussian random fields, the 
covariation function is given by 

k(s, t) = 2-"^^C{s - t)C{0)^''-^^l^ . (13) 

3. Extrapolation methods 

Let X be an a-stable random field of the form (|6]) and 1 < a < 2. In Sections [3.1f[3.3| we present three approaches 
that yield the weights A^,. . . ,A„ e M of the linear predictor 



X{t^)^Yj^iX{ti) (14) 

1=1 



for the value X(fo) at the location fo G Hi'' based on the values X(ti), ... , X{t„) at the neighboring locations fi , . . . , f„, 

neN. 



A predictor X(toJ for X(to) is called exact if X(to) - Xito) almost surely whenever to - f,- for some / e { 1 , . . . , n). 
We say that X(toJ is unbiased ifE(X(to)-X(to)) - 0. It follows from representation m that EX(t) = for each t e R^, 



hence the predictor (14 1 is always unbiased 



For each fo e M"^, the linear prediction yields a set of weights Ai,. . .,A„. Let us consider these weights as functions 
/I; : K'' ^ K of the locations f € M"' and let (Q, ;F, P) be the underlying probability space of the random field. If the 
functions /!,■,/= !,...,«, are continuous, the extrapolator X : M'' x Q — > M given by 



X{t, w) = V Mt)X(ti, w), te 



is continuous for each w € Q. In this case, we say that the predictor is continuous. 

3.1. Least Scale Linear (LSL) predictor 

We noticed that the idea behind kriging is the minimization of the prediction variance. Since the variance of a 
Gaussian random variable is twice the scale parameter of a 2-stable random variable, an obvious generalization of the 
kriging technique is the minimization of the prediction scale 



X(,to)-X{tB) 



- f Mx)-J]AJ,ix) 



m(dx) 



(15) 



with respect to /li, . . . ,A„. Here, o"j~~ is the scale parameter of the a-stable random variable X(fo)-Z(fo), cf. til. 

The predictor X(fo) based on a solution of this minimization problem is called Least Scale Linear (LSL) predictor. 
The LSL predictor can be further justified as follows. Let {X,„(fo))„,gN be a sequence of predictors for X{to). First 

tends to zero as m — > oo. Second by 



by (8 I, X„,{to) tends to X{to) in probability as m ^ oo if and only if crxlj~-,_x(, ) 

ML the mean p-error between Xmito) and X(to) tends to zero for every p G (0, a) as m 



oo if and only if cr 



tends to zero as m 



oo. That is why it is reasonable to minimize crZ — _ in (fTSll. 

X{ro)-X(to) [__f 

We now derive the necessary conditions for the existence of the LSL predictor. 
Lemma 7. Let M be an a-stable random measure. Then 



XJta)-X(ta) 



X(to)-X(to) 



dAj 



X{tj),Y^AiX{td-X{tQ) 



!=1 



J-U- 



Thus, a solution of the minimization problem ( |T5] l resolves the following system of equations 

= 0, j=l,...«. 



X{tj),X{tQ)-Y^AiX{ti) 



(=1 



which can be written as 






^^<a-l> 

m(dx) = 0, j — I, . 



.n. 



(16) 



(17) 



by ( fTO] ) and the linearity of a-stable integrals. Notice that ([TTJi is nonlinear in Ai, . . . ,An if a < 2. Therefore, 
numerical methods have to be applied in this case in order to solve this minimization problem, for example the 
Levenberg-Marquardt algorithm, see tlSil . 

5.7.7. Properties of the LSL predictor 

It is clear that the set of all LSL predictors is closed and convex, see also 16; p. 59]. 



Theorem 8. The LSL predictor has the following properties: 



1. The LSL predictor exists, is unique and exact. 

2. If the random field X is stochastically continuous and the random vector {X{ti), . . . ,X{t„))^ is full-dimensional, 
then the LSL predictor is continuous. 

Remark 1. The first and second assertion of Theorem l8] follow from the properties of the best approximation in 
L"'(£',m)-spaces for 1 < a <2. Notice that if < a < 1, the quantity ||/||L»(£.m) = ( C- \f{x)rm{dx)YI'' is not a norm 
anymore (there is neither the triangle inequality nor Minkowski's inequality). Thus for < a < 1, the existence and 
uniqueness of the LSL estimator requires additional investigation. 

3.2. Covariation Orthogonal Linear (COL) predictor 

Let X be an a-stable random field. We have seen that the LSL predictor can be only calculated by numerical 



methods because the system of equations (17 1 is nonlinear. The linearity of the covariation in the first entry suggests 



to exchange both entries in ( 16 1 such that we get the system of Unear equations 

n 

fx(fo), X{tj)\ - 2 ^i [X{ti), X(tj)\ = 0, ;• = 1, . . . , n. (18) 

Since the covariation of X(fo) - 2"=i ^iX{ti) on X(tj) is zero for j - 1 , . . . , n, the linear predictor X(fo) - 2/Li -^i^iti) 



based on any solution {A\,. . . ,A„) of (18 i is called after |8| Covariation Orthogonal Linear (COL) predictor. 



The unknown quantities [X{t{)),X{tj)\a and [X{ti),X{tj)\a in (18l can be estimated either by using (12i in the 
symmetric case or by estimating the kernel functions and using \\Q) in the non-symmetric case. By ( [T8| ), the COL 
predictor is the solution of the following system of equations 

[X(fo), X(f,)]„ = [Xito), X{ti)]a, i^l,...,n, 

which is equivalent to 

E (x(fo)X(f,)<''-'>) = E {x(^)X{t,)^P-'^) , / = 1, . . . , n, 

in the case of an S aS random field by ( [T2| ). 

If the similarity of two (T-stable random variables is measured by the covariation, the first system of equations 
ensures that the similarity of the theoretical value X{tQ) and X(ti) is exactly equal to the similarity of the predictor 
Z(fo) and X(f,). The second system of equations guarantees that the "mixed" moments between the theoretical value 
X(fo) and Xiti) agree with the "mixed" moments between the predictor X(fo) and X{ti). 

For a detailed treatment of the COL predictor of discrete stationary ARMA a-stable processes, we refer to fSJ. 
The following lemma connects linear regression with the COL predictor, see 1 1 8 , Corollary 4.1.3]. 

Lemma 9. If the regression of X{tQ) on the random vector (Xiti), . . . ,X{t„')Y is linear, i. e. there exists some 
(/li, ...,/!„) e M" such f/zaf E(X(fo)|X(fi), . . . ,X(f„)) — YH^i'^i^iti) almost surely, then the vector (Ai, ... ,A„y is a 



solution of the system of equations ( 18 L 



The regression of X(fo) onX(fi) is always linear, see fTSl Theorem 4.1.2]. If n > 2, then {X{tQ),X{ti), . . .,X{t„))^ 
has the multiple regression property if and only if (X(to),X(ti), . . . ,X(f„))^ is Gaussian or sub-Gaussian, see IITSl 
Proposition 4.1.7]. Thus for n > 2, Lemmal9]can be appUed to Gaussian and sub-Gaussian random fields. 

In the next subsections, we analyze existence, uniqueness and continuity of the COL predictor and concentrate 
on moving average, Gaussian and sub-Gaussian random fields. Only for these kinds of a-stable random fields, we 
know how to derive reasonable sufficient conditions such that the properties hold. Notice that for < a < 2, any 
stationary SaS random field X can be decomposed into three independent parts X = X*'' + X*^' + X^'^\ where X*'* is a 
mixed moving average, X^^^ is harmonizable, and X^^^ is a stationary SaS process without mixed moving average or 
harmonizable components, see iflTJI . Moving averages are a subclass of mixed moving averages, while sub-Gaussian 
random fields belong to the classes X^^^ or X^^\ cf. flS", Theorem 4.7.5 and Theorem 6.6.5]. 

Exactness of the COL predictor holds for all kinds of a-stable random fields which directly follows from the 



corresponding system of equations ( 18 1 



3.2.1. Properties of the COL predictor for Gaussian and sub-Gaussian random fields 

Let us first consider a stationary zero mean Gaussian random field G with a positive definite covariance function 
C. The system of linear equations ([T8]l becomes 



I C(0) 



C{t„ - fi) 



C(t„-ti)\ 



C(0) 



Ml 



^ij 



(C(to - tj 



.C{to - tn). 



(19) 



Therefore, the matrix on the left hand side of (19 1 is positive definite and the system of equations has a unique solution, 
i. e. the COL predictor exists and is unique. Notice that the system (19 1 coincides with the system of linear equations 
for the weights in simple kriging, see e. g. [ 19 , p. 24]. 

In the sub-Gaussian case, the system of Unear equations ( 22 1 for the weights of the COL predictor coincides with 
^ due to ([T3]i. 

Remark 2. The fact that this method is well tractable makes it attractive for applications. Nevertheless it cannot 
cover all cc-stable random fields because sub-Gaussian random fields have the property of long dependence (see IfTSl 
Proposition 4.7.4]), so they are a very particular case of stable fields. 

Theorem 10. If the covariance function C is continuous, then the COL predictor for Gaussian and sub-Gaussian 
random fields is continuous. 



If fo "^ tjfovi - 1, 
problem 



, n, the Maximum-Likelihood (ML) predictor X(f()) ofX(to) is the solution of the optimization 

fx(to)\x(H)=x,,...,x(i.,)=x.Sx) -^ max. 

xeR 

If to = ti for some / = 1, . . . , n, we have 

P(X(fo) = x,|X(fi) = xi, 



,X(f,)=X;,...,X(f„)=X„)= 1 



(20) 



such that the ML predictor is X{to) = X(ti). Closed formulas for the ML predictor for sub-Gaussian random fields are 
provided by lfT6l . 

Theorem 11. For Gaussian and sub-Gaussian random fields, the ML predictor is equal to tlie COL and LSL predictor 

There exists an example for which the COL predictor is distinct from the LSL predictor. 

Example 1. Let X be the SaS Levy motion defined by X{t) - L l(x < t)M(dx), where M is an SaS random 
measure with Lebesgue control measure. Let to - 3/4 and fi = 1. Then the optimization problem for the LSL 
predictor is 



X(Ib)-X(Io) 



/-3/4 

Jo 



1-Ai\''dx+ f \Ai\"dx 
J3/4 



= ^|l-^ir+i|^ir ^ min. 

4 4/11 

The last equation impUes that the minimum is attained for some Ai e [0, 1] and we can therefore replace the absolute 
values by brackets. By setting the derivative of the last equation with respect to Ai equal to zero, we obtain the LSL 
predictor 



The COL predictor is 



1 -H(l/3)i/('»-i) 



^7-,_ [X{to),xm 3 

^^^°^-[X(rO,X(.0]/^''^-4^^"^ 



and thus differs from the LSL predictor except for a - 2. 



3.2.2. Properties of the COL predictor for moving averages 

In this subsection, we restrict our setting to moving average random fields of the form 



X{t) 



/ 



fit - x)M(dx), 



t e . 



(21) 



where M is an a-stable random measure with Lebesgue control measure. This restriction allows for imposing condi- 
tions on the kernel functions that guarantee the existence, uniqueness and continuity of the COL predictor. 

We now state some properties of such moving average random fields. Let h e W'. Since X is stationary, it holds 
[X{!i),X{0)]a = [X{t + h),X(t)]a for each t e M.''. Therefore, the covariation function of X is a function of just one 
variable and we use the notation K(h) = [X{h),X{Q)]a- 

Lemma 12. If the kernel function f : W^ ^> IR+ of the moving average {21) is positive semi-definite, then the 
covariation function k is positive semi-definite. If f : W^ — > M+ is positive definite and positive on a set with positive 
Lebesgue measure, then k is positive definite. 

It is clear that the COL predictor is unique if the covariation function is positive definite since the matrix of the 
system of linear equations 



^(0) 



K{tn - ty)\ 



(M\ 



■^n, 



(K{to - ti)\ 
K(to - t„). 



(22) 



U(f„-fi) ■■■ k{Q) 

is positive definite. An example of an a-stable moving average with a positive definite kernel function is the S aS 
Ornstein-Uhlenbeck process with 



X{t) 






~A(t-x) 



t{t-x> 0)M(dx), t e ; 



for some /I > 0. If fi < f2 < ■ • ■ < f« < to, then the regression of X(to) on (X(ti), . . .,X{t„))^ is linear (cf. [JJ, p. 138]), 

i.e.Xi^)^ e-''('o-'")X(f„). 

Theorem 13. If the covariation function is positive definite and continuous, then the COL predictor is continuous. 



The proof is analogous to the one of Theorem 10 For example, all continuous kernel functions with compact 
support yield a continuous covariation function by the dominated convergence theorem. 

3.3. Maximization of Covariation Linear (MCL) predictor 
The idea of this method is to maximize the covariation 



[x(^,X(ro)]_^ ^YjAi [X(ti),X(to)]„ 



between the linear predictor X(to) and the theoretical value X(to). In general, if we do not impose any further restric- 
tions and if [X(f,),X(fo)]„ ^ for some / € {!,...,«), then the maximization problem 



yA,[X(ti),X(to)], ^ max 

' ■ Ai A. 



Ai,...,A„ 
1=1 

obviously does not have a solution. A reasonable side condition is 

which guarantees X{to) - X(tQ) for SaS random fields X. The optimization problem becomes 

f[x(f;r),^(fo)l ^ max, 

JL iLY Au...,A„ 



(23) 



(24) 



The predictor X(tQ) - 2"^[ /l,X(f,) whose weights /li , . . . , /l„ are a solution of the maximization problem ( 24 1 is called 
Maximization of Covariation Linear (MCL) predictor. 



3.3.1. Properties of the MCL predictor 

The following theorem provides sufficient conditions for the existence, uniqueness, exactness and continuity of 
the MCL predictor 

Theorem 14. Assume that the random vector {X{ti), . . . ,X(t„))^ is full-dimensional and to e M.''. Then the following 
holds: 

1 . The MCL predictor exists. 

2. If additionally K(ti, to) + Ofor some / e {1, . . . , n), then the MCL predictor at to is unique. 

3. If the MCL predictor is unique, then it is exact. 

4. If K{ti, to) + Ofor some / e { 1, . . . , n) and k is continuous, then the MCL predictor is continuous in to. 



Remark 3. We have already seen in Section 3.2.2 that for moving averages, a sufficient condition for the continuity 



of the covariation function is ffiat the kernel function is continuous and has a compact support. 

4. Numerical results 

In this section, we apply the extrapolation methods to a sub-Gaussian random field and an S aS Levy motion on the 
square [0, 1]^. For this, we generate 1000 realizations of both random fields on an equidistant grid of 100 x 100 points 
and extrapolate each realization by using the values x(ti), . . . ,x{tg) at the locations fi - (0.2,0.2)^, f2 = (0.2,0.5)^, 
f3 = (0.2,0.8)T, t4 = (0.5,0.2)T, f5 = (0.5,0.5)T, t^ = (0.5, 0.8)"^, tj = (0.8, 0.2)"^, fg = (0.8, 0.5)"^ and tg = (0.8, 0.8)"^. 

The sub-Gaussian random field X = {A'^^G(r), t e [0, 1]^) has the stability index a = 1.5, where G is a stationary 
Gaussian random field with Gaussian covariance function C(h) - 7 exp{-(/!/0.1)^), h > 0. Recall that in this case, the 



LSL, COL and ML predictors coincide by Theorem 1 1 Due to the specific structure of sub-Gaussian random fields, 
we also provide a conditional simulation (CS) of X, i. e. a simulation of X that honours the conditions X(ti) = x(f,) 
for / = 1, ... ,9, see |12|. The conditional simulation can be seen as another extrapolation method and carried out 
straightforward by conditionally simulating the Gaussian part G of X and scaling it appropriately with a realization 
of A^^^. A conditional simulation algorithm for Gaussian random fields is given in 1 12|. For a simulation algorithm 
for A, see jTSj. Figure [T] shows a realization of X and the extrapolations based on the LSL (COL, ML), MCL and CS 
methods. 



Table 1 : Summai'y statistics for the deviations X(g) - X{g) (sub-Gaussian random field) 



Method 


5'7o-Quantile 


1 St Quartile 


Median 


Mean 


3rd Quartile 


95%-Quantile 


LSL (COL, ML) 

MCL 

CS 


-1.5451 
-1.8204 

-2.7523 


-0.4446 
-0.4899 
-0.5837 


0.0018 
0.0046 
0.0058 


0.0070 
-0.0188 
0.0057 


0.4503 
0.5016 
0.5985 


1.5363 
1.7580 

2.7262 



In order to assess ffie performance of ffie predictors, we calculated the deviations X{g) - X(g) of the extrapolated 
values from the simulated ones at each grid point g of the 1000 reaUzations of the sub-Gaussian random field. The 
summary statistics of the deviations are shown in Table[T| As one can see, there are only marginal dififerences between 
the quantiles and the mean of the deviations for the three methods, the LSL (COL, ML) and MCL method performing 
slightly better than the CS method. 

Consider now the two-dimensional SaS Levy motion Y with stablility index a - 1.5 on the square [0, 1]^ defined 
by Y(t) - [ , IIjci < ti,X2 < t2}M(dx) for t e [0, 1]^, where M is an SaS random measure with Lebesgue control 
measure. Figure |2] shows a realization of X and the extrapolations based on the LSL, COL and MCL methods. 

Again, we investigate the performance of the extrapolation methods by calculating the summary statistics of the 
deviations of the extrapolated values from the simulated ones. Table l2] shows the corresponding results. As for the 
sub-Gaussian random field X, no method clearly outperforms the others. 
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Figure 1: Realization of the sub-Gaussian random field (top left) and the extrapolations based on the LSL (COL, ML) method (top right), the MCL 
method (bottom left) and the CS method (bottom right). 



Table 2: Summary statistics for the deviations X(g) — X{g) (SaS Levy motion) 



Method 


5%-Quantile 


IstQuartile 


Median 


Mean 


3rd Quartile 


95%-Quantile 


LSL 
COL 
MCL 


-0.5170 
-0.5263 
-0.6093 


-0.1246 
-0.1289 
-0.1455 


0.0000 
0.0002 
-0.0007 


-0.0071 
-0.0061 
0.0283 


0.1226 
0.1266 
0.1407 


0.5045 
0.5137 
0.5895 



5. Discussion and open problems 

For sub-Gaussian random fields, the LSL and COL methods can be efficiently implemented and easily applied 
to larger data sets of at least 1000 sample points since efficient algorithms to solve linear systems of equations are 
available. For other kinds of a-stable random fields, the COL predictor can still be implemented efficiently for large 
data sets since only a system of linear equations has to be solved. In the LSL and MCL methods, a function whose 
dimension equals the number of sample points needs to be numerically minimized and maximized, respectively, 
impeding the application of these two methods to large data sets. 

We notice that we have proven the properties of the LSL, COL and MCL predictors for a-stable random fields 
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Figure 2: Realization of the Levy stable motion (top left) and the extrapolations based on the LSL method (top right), the COL method (bottom 
left) and the MCL method (bottom right). 



with integral representation (J6]l and a > I. All of these methods do not involve the skewness of the random field X. If 
X is SaS , then obviously so is X as it is a linear combination of SaS random variables. If the skewness function j6 of 
X is not zero, then easy calculations show that the skewness parameter of X(t) - 2"^j /l,X(f,) is given by 



(a) 



cf.im Property 3.2.2]. 

The ML and CS predictors can be immediately extended to the case a < 1, but they are only available for Gaussian 



and sub-Gaussian random fields. Also, the minimization problem (15 i in the LSL method can be considered for a < 1, 
but except for the case a = 1, the objective function will change from convexity to concavity in A - {A^,. . ., A„j^ and 
it is not clear whether the properties of the LSL predictor still hold. The development of extrapolation methods for 
ff < 1 is thus an interesting problem for future research. 

Another interesting open problem is a characterization of the covariation function which has been touched upon 



only slightly in Lemma 12 
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Appendix A. Proofs 

Proof of Lemma^ Let suppiT) denote the support of F and assume that supp(Y) c §"'"' n Gc,_...,c,, for some (d - 1)- 
dimensional subspace G^, ^ '■- {{x\, . . . ,x^)^ e K"* : cjXi + . . . + c^x^ - 0) with ci, . . . ,q € M. Let us consider 
Yfi=i CiXi. Using 1 18t Example 2.3.4], we obtain 



„ d " d 

I— I i-l-.-.L^l [_^ 



r(ds) = 



Since ^ = 0, we have 2f=i c,X, = almost surely. 

Vice versa, if 2^^j c,X; = almost surely, then a-" ^ - Cj_[ l2f=i Q'^ir r(iii) = 0. Thus F is concentrated on 

the great sub-sphere Gc,,...,,, := {(^i, . . . , Sd)^ e S"'"' : 2f^j c,5; = 0) of S''"'. D 

froo/ q/ Lemma |5] Let E+ :- {x e E : f(xf + /iW^ > 0) and gj : E ^Rhe defined by 



gj(x) := 



xeE, ; = 1,2. 



(/lW'+/2W2)l/2' 

Then we have for any Borel set A c §' 

r 1 + I3(x) I , ,\a/2 f 1 - y6(x) / , i\Q-/2 

r(A)= ^^ /i(x)2+/2(x)2) m(flfx)+ ^!Li /i(^)2+/2(x)2) m{dx\ 

Jg-HA) 2 J?->(-A) 2 



where g-^A) := {x e £+ : (giW,g2W)"^ e A), see fTS^, pp. 115]. Let S' = {(.?i,.?2)"^ e §' : si52 < 0). It holds 
S^ - -S. The random vector (X, Y)^ is associated if and only if 



nS-)^ r (f(xf+f2(xfy'^m(dx)^0, 

Js-'(S-) 



see IfTSl Theorem 4.6.1]. This is equivalent to m{g \S )) = 0, that is /1/2 > m-almost everywhere. The proof for 
negative association is analogous by using IfTSl Theorem 4.6.3]. D 

P roof of Corollary^ By IfTSl Theorem 3.5.6], (X, Y)^ has an integral representation 



(X,Y) 



'-'(L 



f(x)M(dx), f f2(x)M(dx) 

E Je 



where M is an ff-stable random measure with control measure m and skewness intensity function /3. We define 
£* := {x e £ : /i(x)/2(x) > 0), Xi := J^fi(x)tE.(x)M(dx), Yi := J^f2(x)lE.(x)M(dx), X2 := X-Xi and F2 := Y-Yu 
The dependence properties of Xi, X2, Fi and F2 follow immediately from Lemma |3] and the fact that an a-stable 

random vector (U, V)^ - (j^ gi(x)M(dx), J^ g2(x)M(dx)] has independent components if and only if gig2 - m- 
almost everywhere, see ifTSl Theorem 3.5.3].. D 

Proof of Lemma^ By HH Property 1.2.17], we have E\AX + Y\p = EI^I'V^^^j, for ^ € M, where ^ ~ 5„(l,y6^x+F,0) 
and Pax+y - £1 i^^i + S2)'^"^r(ds) / £, \Asi + S2fT(ds) . Taking derivatives on both sides, we get 



d 

dA 
d 
dA 



E\AX + Yf 
M\'<x.Y 



pEi^Y^P-^"-) , 



^=0 



P(t\-"\X, F], El^n.^o + 4 —Elf I' 
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(A.l) 



i=0 



A closed formula for E\^\'' is given in 1 18 , p. 18]. After some cumbersome calculations, we obtain 



m''\A=o = Wf/cr'y, 



dA 



m\" 



E\Y\P 
= P^-c-(iX,Y)„-/3Y[X,Y],). 



Plugging these formulas in ( A. 1 1 and equating both derivatives yields the assertion. 



n 



Appendix A.l. Proofs for the LSL predictor 

Proof of Lemma^ Let Aq :- -1. Then we get for y = !,...,« 



X{to)-X{to) 2.,=o ■^•^(K 



r " 



r{ds), 



where F is the spectral measure of the random vector iX(to), . . . , X(t„))^, cf. llSl formula (2.3.3)]. It is easy to see that 
for j - !,...,«, the partial derivative -jj- |mLo AiSi\ (as a function of Aj) is uniformly bounded in (sq, ■ ■ ■ , s„y e S" 
if a > 1 . Then since F is a finite measure, it follows from the dominated convergence theorem that 



dAj x(to)-x(to) 



'lAP-\ 



= 


r d 

Js" dAj 


n ' 
/■=() 


Si 


<a- 1 > 

r( 


ds) = a 



Fids) 

n 

X{tj),Y^AiX{ti)-X{tQ) 



see IfTSl Lemma 2.7.5]. 



D 



Proof of Theorem^ Assertion 1 follows from |6, Theorem 1.1, p. 59], the discussion thereafter and Lemmal2] The 
exactness of the predictor is obvious. We now prove the second assertion. Since X is stochastically continuous, we 
have by ^ and (^ 

Wfs - ft\\L"(E,m) ^0, S^t, 

where || ■ \\L"{E,m} denotes the usual norm of L"{E, m). Let /, - Y!U\ ■^iiOfi for each t e M"'. Then it holds 



P' MfiE.m) ~ 



Y,(Ai(s) - Ai(t))f, 



0, s^t, 



(A.2) 



L''(E,m) 



see Theorem 1.2, p. 60]. 

Assume that Ai(s) -« Ai(t) as s ^ f for some i e {!,... ,n}. Then -\j(Ai(s) - /ii(f))^ + ■ ■ ■ + (An{s) - A„(t))^ -^ ; 
s ^ t. Since 

Aiis) - Ai(t) 



V(^i(s) - Ai(f))2 + ■ ■ ■ + (A„(s) - ^(0)2 
there exists a sequence {itljteN with ij; — > f as A: — > oo such that 

Ai(sk) - Ai(t) 



< 1, i- !,...,«, 






y/{Ai{sk) - Aiit))^ + ■■■ + {A„{sk) - ^(f))2 



— > y,-, A: — > oo, i—l,...,n. 



Notice that (yf )^ = 1 - Ii"=2(yf V for each k e N such that y,- ^ for some / e {!,...,«). By (A.2 1, we have 
II E)Li 7ifii\\L''(E,m) - which implies Y/i=i Jif, - m-almost everywhere. By Lemmal2| this is a contradiction to the 
the full-dimensionality of {X{ti), ..., X(t„)y. D 
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Appendix A.2. Proofs for the COL predictor 



Proof of Theorem 10 Let fo G I^''- The matrix on the left hand side of equation ( 19 1 is a bijective continuous lin- 
ear operator. By the open mapping theorem, the inverse operator is continuous. Since the covariance function is 
continuous, the weights A\,. . . ,A„ (considered as real-valued functions on W^) are continuous in fo- D 



Proof of Theorem 11 Let A be a lower triangular (n -H 1 ) x (« -H l)-matrix with the property 



(A.3) 



where / denotes the identity matrix and O,, __,,.,„ is the covariance matrix of the Gaussian part of the random vector 
(X(?i), . . . , X{tn), X{tQ)y . Then the ML predictor for Xito) is given by 



X{to) 



[i: "=i S^(f/)' fo * U for all / e { 1 , . . . , n), 
I X{ti), to - ti for some / e { 1 , . . . , n) 



(A.4) 



where o/j denotes the entry in the /-th row and j-\h column of A, see Iil6i . Let C be the covariance function of the 
Gaussian part G of the sub-Gaussian random field X. We have O,, ,_ ,„ = 2(A^A) ' andA = B ', where B is the lower 
triangular matrix of the Cholesky decomposition of Q,,_,^,_,„, i. e. Q,,,. ..,/„,/„ = 2BB^. Notice that the last column of the 
matrix -l/a„+i^„+i ■ A^ consists of the coefficients -««+!,! /a„+i,„+i, . . . ,-a„+\^„/a„+i^n+\ of the ML predictor and the 
number -1. Let Aj - -fl„+i,,7fl„+i,„+i for / = !,...,«. We have 



1 



2fl«+i,«+i 

1 

/ 

fln+l,n+l 



n,„ 



-1 



■,l,:,tO 



A^- 



1 



^n+I,«+l 

•^1,1 



-{A'^Ay^A'^ = A"'(A"^)"'a"^ 



Qn+l,n+l 



1 



-B 



fln+l,n+l 














for some real numbers xij, 
equation yields 



■ , -^n+i.n+i ■ By only considering the last column of the left and right hand side of the last 
f C(0) ■■■ C(t„-ti)\(AA (C(tQ-ti)\ (0\ 



,C{t„ - ti) ■ ■ ■ C(0) ) \A„) \C{tQ - 1„)) \Q, 

which is the system of linear equations that has to be solved for the COL predictor. Since the COL predictor is unique, 
it must be equal to the ML predictor. 

We now show that the COL predictor is equal to the LSL predictor. Let X - {A'^^G(f), t e W'] be a sub-Gaussian 
random field. We have XXIq) - X(fo) = A'^^ ^^^g /t,G(f,), with ^o = -1 and 






V;=0 



'' i,M 



With |[T8] Proposition 1.3.1], we get 



cr_- 



X(to)-X(to) 



1 " 

- Y, '^i'^fiti - tj) 



\ i.j=0 



a/2 



mm 

A,,...,A,, 



which is equivalent to 



y AiAjC(ti - tj) -^ min 



M,--A„ 



Taking partial derivatives and setting them equal to zero shows that the LSL predictor is equal to the COL predictor. 
The calculations for Gaussian random fields are analogous. D 
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Proof of Lemma\l2\ Let n € N, zi, . . . ,z„ € E and fi, . . . ,f„ € W^. It holds 

n r rt 

^ K{ti - tj)ZiZj = Yj ^(^' ~ ^i^^'^>' ^^^^ 



'■j=i 



L',>=i 






2 /(f,. - f^. - x)ziZjf"-\-x)dx > 



if / is positive semi-definite and f(x) > for all x e R''. We consider (zi, . . . ,z„y + (0, . . . ,0)^ for the positive 
definiteness of k. Let A be the set where / is positive with positive Lebesgue measure. Then -x € -A if and only if 
X e A and 



n ^ n 

^ K{ti - tj)ziZj > I Yj /(^' ~ ^i ~ x)ziZjf'-"'^\-x)dx > 0. 



D 



Appendix A.3. Proofs for the MCL predictor 

Proof of Theorem\l4\ 1. Let C := {(^i, . . . ,^)"^ e R" : o-^;^, i.xft) = o-x(,o)}- Let ^2 = ■■■ = /?« = 0. Then 
o"Z;Li -i.^C.) ^ o--iiJs^('i) = l'^ilo"x(r,) such that Ai = +crx(,o)/a-x((,)- Therefore, the set C is non-empty. Since 
U'iE, m) is a linear space, cr^" /i,z(/;) is a continuous function in /I - (Ai, . . . , A„y e M" by Lebesgue's the- 
orem on dominated convergence. Thus the set C is closed. By Lemma l2] the functions /,,, / = 1, . . . ,n, are 
linearly independent. Due to this, cr^i^ ^.x(,.) - jg | Xi"=i ^iftiMf'nidx) tends to infinity as \\A\\2 — > oo so that 
C is bounded and hence compact. Since the objective function is continuous, there exists a solution of the 
optimization problem. 
2. Recall the optimization problem 

('fx(f;0,X(fo)l -^ max, 

|L Jo- A, A.. 



Ai,...,A„ 



(A.5) 



X{to) 



- <^X(to)- 



Define the function T : 



^Kby 



XUo) 



/=1 



A^(A],...,A„y eM". 



It is obvious that ^ is continuous. By Minkowski's inequality, ^F is convex and strictly convex on the set of 
admissible points given hy K:- [A - {A\,. . . , A„y e W : *F(/l) - o-x(ig)}, that is 

^08/'^ + (1 -P)A'^^) < /?*P(/l^'^) + (1 -P)'¥(A'^^) 

for all yS e (0, 1) and A'-^\ /l*^) e A with /i^^' ^ A®. 

Indeed, let /'>, Z^) g a with /"> ^ ^f^) j^^^j^ ^ (q, 1). We have 



»I'08/"-H(l-/3)/2))^ 



^X^fV. + (i-/?)2^fV. 



Assume that 

n n 

1=1 1=1 

for some y > 0. By Lemmapl this contradicts the full-dimensionality of the vector (X(ti), . . . ,X(f„))^. Analo- 
gously, by exchanging jS and 1 - jS, we have 



(1-/3) J] Af\f,(x) ^JPYj ^?f':^^'^ '" - «-^- 
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/=i 



1=1 



for all y > 0. The Minkowski inequality yields \\g + h\\a < \\g\\a + \\h\\a for all g, h e LfiE, m) and equality holds 
if and only if g - yh or h - jg m-almost everywhere for some y > 0. We conclude that 



1'0S/'>+(l-y6)/2^) = 



< j6 






+ (l-/S) 



(=1 1=1 



i=l 



:y6>l'(/") + (l-j0m/l®) 



such that ^ is strictly convex on A. 

Consider now the set B :- {A e M" : ^(A) < o-x(t„)}- B is convex since *? is convex. Moreover, it is strictly 

convex which can be shown as follows. Let A € dB, where dB denotes the boundary of B. Then ^(A) - crx(if,) 

because otherwise ^(A) < crx(to)^ ^"d since *P is continuous, there exists an e > such that ^(x) < o-x(,g) for all 

X e B^(s) :- {x eM" : \\x - A\\2 < s}. Therefore, B,i{s) c B which is a contradiction to A e dB. 

Let A'^^\ /l*^' G dB andyS e (0, 1). We have already shown that 

vi/(^^(l) + (1 -^)i(2)) </3>P(^('>) + (1 -/?)>I'(^(2)^ ^ ^^^^^^^ 

SO yS/l*^' + ( 1 - /3)A^^^ e B, where B denotes the interior of B. Therefore, B is strictly convex. 
The strict convexity of B implies that for each u e M", the support set 



T(B, u)^{yeB: {y, u) = h(B, u)] 
consists of a singleton [x], cf. the proof of lfT4l Theorem 4.5], where 

h{B, u) - sup{(jt:, u) : X e B] 



(A.7) 



(A.8) 



is the support function of B. It is clear that x e dB. Recall that the optimization problem ( A. 5 i can be written as 

{A, a) — > max 



(P)' 



A&A 



where 



a := ([X(ti),X(tQ)]„,...,[X(t„),X(to)]a)'^, 

A := [A^iAu..., ^„)^ e R" : cr^^^ ^,x(,) = crx(,,)} 



Consider the optimization problem 



(PI 



(A, a) — > max 



which has a unique solution A* - T{B, a) e dB by (A.7 1 and (A.8 1 since T{B, a) consists of only one element. 
We have already seen that dB c A such that A* is the unique solution of (P), too. 
3. The Lagrange function L : M" x M — > M of the optimization problem (A. 5 1 is given by 



L(A, y) = ^ Ai[X(ti), X{to)]a + y (crj;;;, AiXir,) - Crx(,„)) . 



/=1 



By taking partial derivatives and setting them equal to zero, we get the system of equations 



[X(tj),X(to)]a+7 



X(tj),J]AiX(ti) 



= 0, j=l, 



■ ,n. 



!=1 

0-Xl^AiX(t,) - crx(to)- 
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Suppose that t^ - to for some k e {!,...,«). Then (A*, y*) with 

^1, / = k. 
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1 and A* - { ' ' ^ = 1, 

' lO, ii^k. 



is a solution of the system of equations and therefore a critical point of the objective function. Since the MCL 
predictor is unique, it is given by X(/o) = Y!U\ ^*^(fi)- 
4. Let C be an arbitrary set and g : C — > M be a function. We set 

inf g(C) := mf{g(x) : x e C), 
M(g,C):^{xeC:g(x)^mfg(C)}. 



For a set M c M" and a sequence (M/)/gN of subsets of M", we define 

M = lim Ml o lim c/(x, M/) = 0, x e M and Um inf (i(x, Mi) > 0, x i M, 



(A.9) 



where d{x,M) :- inf„,gM \\x - mlb, cf. IfTOl Anhang 1, Bemerkung 1]. Notice that this definition is equivalent 
to the HausdorfF convergence, see ifTOl Anhang 1, Satz 4]. The following fact provides sufficient conditions for 
the stability of the solution of an optimization problem, see ifTOl Stabilitatssatz 5.4.2]. 

Let (S „),„£N be a sequence of closed convex subsets ofR", n € N, with lim,„^co S ,„ :— S. Let (O^ '■ IR" ~> ]R)meN 
be a sequence of convex functions which converges pointwise to some function O : M" — ^ M. If M{^,S) consists 
of a singleton [x], then x„ € M{<^„, S „,), m € N, implies limm^oo x^ — x. 

Let ism)mm c M'' with hm„^oo Sm - to- We set 

S,„:^UAi,...,A„)'eR": f 

S :-|(^i,...,^)^eM": r 

n 
^nM) -.^ -J]Ai[X(ti),Xis,„)], 

1=1 

n 

<:>(A):^-Y^Ai[X(td,X(to)]a. 




We notice that we have shown in the second part of the proof that the constraint cr^j—r - o-x(ig) can be replaced 
by o-jr~~ < crx{i„). Thus, we can consider S as the set of admissible points of the MCL optimization problem. 
Furthermore, the previous fact is formulated for minimization problems, but the MCL predictor requires max- 
imization. Therefore, the functions O,,, and O are defined with a negative sign to adjust for this fact. Since the 
covariation function is continuous, the sequence (<I>,„)„,gN converges pointwise to O. Also, M((i>,S) consists of 
a singleton {A(to)} since the MCL predictor is unique. As lim,„^oo s„ = to, there exists some niQ € N such that 
the set M{<I>,„,S„,) consists of a singleton for all m > mo since the MCL predictor is unique in a neighborhood 
of to- Clearly, the sets Sm, '« £ N, are closed convex subsets of M" since the function ^F ; M" — > M defined by 



^'(A) 



JE ;^j 



midx), A = (Ai,...,A,y eR", 



is continuous and convex. It remains to prove that lim,„^t)o S,,, - S . 

We need to show that lim,„^oo d{Ao, Sm) - for all A^ e S and lim inf^^oo 

to (Km. 



d(Ao,Sm) > for all Ao i S according 
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First let A{) e S . We construct a sequence (/lm)meN with A^ e S„, such that Hnim^oo A,„ = /Iq- Let e > 0. If 
A() e Sm, then we set A„ :- Aq. If Aq i Sm, then by the definition of 5,,,, it holds ^(Aq) > 0. Since *!* is convex, 
any local minimum is a global one. Obviously min^gRn ^(A) - *I'(0) = and therefore, Aq cannot be a local 



minimum such that 



"¥„{„ := min '¥(A) < ^'(Ao) < max =: ^'„ax, 

AeB^Ao) AeB,(Aa) 



where BsiAo) :- {AeR" : \\A - iolb < e). As /lo e 5, we have '¥(Ao) < K(to,to) which implies *P„„„ < K(tQ, to). 
Since k is continuous and limm^oo Sm - to, there exists some mi e N such that *?„,„ < K(sm, s„) for all m> nii. 
As /lo ^ 5m, we have ^(/lo) > f(sm, */«) which implies K{sm, s^) < ^max- We have shown that 

^ min ^ ^\^m^ ^m) ^ ^max ^ffl ^ m^. 

We can find some A^ e Bs(Ao) by the intermediate value theorem such that 'V(A„) - k(s„, s^) since 'P is 

continuous, that is P^ - /lolb ^ e for all m> mi and limm^oo /Im = M)- 

Now let /!() ^5. It holds ^(A^) > K(to, to). Since *!* is continuous, there exists some 6 > such that 

^'(A) > .(to, to) + '^^^°^"/^°-^°\ V^ e B,(^o). 
Due to the continuity of k, there exists some 1112 e N such that 



^^ , ^>{Ao)-K(to,to) 
K(s„, s„) < K(to, to) + , Vm > m2, 

which implies for all A € Bg(Ao) and m > m2 

l'(.l) > K(to, to) + > k(s„, s„). 

Therefore Bs(A()) r\S,„ -% for all m > nix and thus liminfm^oo d(Ao,Sm) > 6 > 0. 

n 
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